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The  linear  systems  approximating  -  in  the  lo^^rest 
order  of  approximation  -  the  2pth  order  elliptic  dif- 
ferential equation  is  derivedo   The  connection  between 
the  simultaneous  and  successive  iteration  schemes  is 
studied.   In  the  case  of  difference  equations  in  two 
dimensions  which  are  separable  the  simultaneous,  suc- 
cessive and  some  alternating  direction  Iteration  schemes 
are  studied  in  detailo   In  particular  the  eigenvalues 
and  eigenvectors  of  the  error  matrix  are  explicitly  ob- 
tained. 
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3II4ULTANE0US,  SUCCESSIVE  AND  ALTERNATING 
DIRECTION  ITERATION  SCHEMES 

lo   Introduction. 

The  various  iteration  schemes  for  the  solution  of 
2p   order  elliptic  difference  equations  in  two  dimen- 
sions are  studied  from  the  point  of  view  of  minimizing 
a  quadratic  form  and  then  from  the  point  of  view  of 
separation  of  coordinates. 

The  general  form  of  the  matrix  of  the  linear  system 
is  given  and  we  note  that  there  is  always  a  possible 
partition  of  this  matrix  into  triple  diagonal  blocks 
such  that  simultaneous  and  successive  iteration  schemes 
based  on  this  partition  will  always  converge.   In  all 
our  examples  we  consider  two  dimensional  meshes »   The 
numbering  of  the  mesh  points  differs  somewhat  from 
author  to  author  so  we  will  spell  out  an  example  in 
some  detailo   In  a  rectangle  vre  number  the  horizontal 
mesh  lines  designated  by  j  =  OjljZ.o.ojV?  while  the 
vertical  mesh  lines  are  designated  by  L  =  0  ,1 ,2 , . »  o  jp, 
(cf.  fig»  Do 
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Figure  1 


The  unknowns  of  the  difference  equations  u.  .  will  be  com- 
ponents of  a  vector 


U  = 


This  arrangement  gives  rise  to  a  convenient  matrix  of  the 
linear  system.   In  the  case  of  non-rectangular  regions 
the  mesh  points  are  still  arranged  as  above  but  each  line 
will  in  general  contain  a  different  number  of  points » 

Because  very  little  can  be  said  about  the  convergence 
rates  of  iteration  schemes  of  general  elliptic  difference 
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equations  of  high  order,  we  consider  those  difference 
equations  In  two  dimensions  in  which  the  coordinates 
can  be  separated.   From  this  point  of  view  we  study, 
for  2p   order  elliptic  difference  equations,  the  con- 
vergence rates  of  line  simultaneous,  line  successive 
and  alternating  iteration  schemes.   In  particular  we 
derive  the  eigenvalues  of  the  error  matrix  for  each  of 
these  schemes  for  any  order  elliptic  difference  equa- 
tions such  that  the  coordinates  are  separable. 


Some  of  these  examples  for  second  order  elliptic  dif- 
ference equations  were  presented  by  Prof.  B.  Friedman 
in  a  seminar  at  N.Y.U. 
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2»   Difference  Equations  Derived  from  Quadratic  Form. 

The  derivation  of  elliptic  difference  equations  from 
a  quadratic  form  mimics  the  derivation  of  the  elliptic 
differential  equation  from  a  variational  princlpleo   In 
deriving  the  difference  equations  that  approximate  an 
elliptic  differential  equation  we  approximate  the  varia- 
tional integral  by  a  quadratic  plus  linear  difference 
form  and  minimize  the  difference  form  with  respect  to  the 
unknowns,  u.  ,   The  variables  u.  defined  at  m.esh  points 
approximate  the  solution  of  the  elliptic  differential 
equation  at  points  p. o 

2. 

The  quadratic  form  is 


(2.1) 


T        T 
2Q  =  U   AU  -  X  B 


where  U  is  the  vector  of  unknowns  u. ,  A  is  a  positive 
definite  symmetric  matrix  approximating,  by  differences, 
the  quadratic  portion  of  the  variational  Integral  and 
the  vector  B  is  the  difference  approximation  to  the  linear 
form  term  of  the  variational  integral. 

For  second  order  elliptic  difference  equations  the 
matrix  A  is  of  the  form 


(2.2) 


A 


/ 


\ 


rt  -1  -1       ^1  O  o  o  o 

^21   ^22   ^23  ^ 

0     A^^   ^33  ^2k      ° 


-  7  - 


A   T     A 
n-1  n   nn   j 


where  n  is  the  number  of  points  in  the  one -dimensional 
case,  the  number  of  lines  of  points  in  a  two-dimensional 
case,  etCo   In  one  dimension  the  elements  A.  .  are  scalars, 
i.e.  the  weights  approximating  the  second  derivative.   In 
two  dimensions  the  elements  A. .  are  matrices.   The  diag- 
onal elements  A. .  represent  the  coupling  along  a  line  of 
mesh  points  and  the  off-diagonal  elements  represent  the 
coupling  with  the  line  of  points  (see  for  example  [I;]). 
(In  general  for  an  n-dimensional  region  the  diagonal  ele- 
ments A.,  are  matrices  coupling  an  (n-1 )-dimensional  mani- 
fold, and  the  off -diagonal  elements  represent  the  coupling 
with  the  remaining  1-dimensional  manifolds  of  the  n-dlmen- 
sional  space. ) 

For  fourth  order  elliptic  difference  equations  the 
matrix  A  is  of  the  form 


(2.3) 


An  -,  A-,  p  A-^-i  0  0  o  .  o 

^21  ^22  ^23  ^2[+  ° 

^31  ^32  ^33  ^3U  ^35  ° 

°  \z  ^i|3  V  \^  \^     ° 


In  one  dimension  the  elements  A.  .  are  scalars  and  repre- 
sent the  five  point  approximation  to  the  fourth  deriva- 
tive.  In  two  dimensions  the  diagonal  elements  A. .  repre- 
sent the  coupling  along  a  line  of  mesh  points  and  the  off 
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diagonal  elements  represent  the  coupling  off  the  line  of 
points;  for  the  simplest  approximation  the  diagonal  ele- 
ments A. .  are  five  diagonal,  the  super-  and  sub-diagonal 

elements  A.  .  ,  and  A.  . . ,  are  three  diagonal  and  the  re- 
1  1-1      1  1+1 

maining  elements  A._p.  and  A.  . ^p  are  diagonal  (see  for 

example  [3,  S ,    6] ), 

th 
In  general  for  the  Zp   order  elliptic  difference 

equations  the  matrix  A  is  of  the  form 


(2.1+) 


[See  p.  lOo ] 


If  vje  partition  the  matrix  A  such  that  the  diagonal 
matrices  are  p^  p  matrices  with  elements  A.  .,  except 
possibly  the  last  block  on  the  diagonal,  we  obtain  a 
form  for  A  which  is  triple  diagonal; 

<3.  ^    0 


{2.S)        A 


-21   ^22  ^23 


0 


0 


^  32   33   3U 


a 


°    k3       kk       kS 


0 
0 


m-lm-2  m-lm-1  m-lm 


0 


^ 


m-l  mm 


We  derive  the  difference  equations  by  setting  the 
variation  of  Q  given  by  (2.1)  equal  to  zero  for  arbitrary 
variations  6u. ,   The  linear  equations  are 
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(2.6) 


AU  =  B 


A  block  successive  iteration  scheme  based  on  the  parti- 
tioned form  of  A  given  by  (2-5) 

(2.7) 


^1  -|        Vj        9  •   O 

^21  ^22  °  -■ 
0  ^32  ^33  0 


m-2m-l  m-im-1 

m  m-1  mm/ 


0  ^^2      0       •  •  • 

0      0      <^23      ^ 

e    o    • 

n+1 

U 

=  B  - 

• 

0    .  .  , 

TTh-l  m 

0    .  .  . 

0 

n 


which  is  one  of  the  many, possible  block  successive  itera- 
tion schemes,  will  converge  [1],  since  A  is  symmetric 
positive  definite.   Defining  the  error  as 


(2.8) 


e(n)  ^  u  _  ^(n) 


we  obtain  from  (2,6)  and  (2.7) 


(2.9) 


^  0 

11   ^ 

21  ^22 


0 


0  ^3^  ^33  0 


/o  ^ 

^   12 


0 


n+1) 


0   0   ^23   0 


0   0 


0  ^3^  0 


n) 


The  asymptotic  rate  of  convergence  t7]  is  determined  by 
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the   X   values    of    the    lambda-error   matrix 


(2olO)         Ax)    = 


^^21      ^^22        ^23        °         -• 

0        xi?32     xa33     ^3^       0 


obtained  by  setting 

(2oll)  det  \£{\)\    =  0 

Convergence  is  guaranteed  (for  infinite  precision),  if 
all  the  values  of  X   obtained  from  (2oll)  are  such  that 


(2ol2) 


1X1  <  1 


The  block  simultaneous  scheme 


(2ol3) 


^i 


0 


°   ^22   ° 


0 


0   ^^3   0 


I 


u 


(n+1) 


B 


/ 


a 


0 


12 

0.^      0  Ci^.^    0 
0  ^3^  0  ^3^  0 


u 


(n) 


gives  rise  to  the  lambda-error  matrix  (where  we  have  used 
cr  s  instead  of  Xs  so  as  not  to  confuse  the  eigenvalues  with 
those  of  "^(X)) 


(2«1U)   ^(^)  = 


c 


a. 


11 


a 


12 


^21  ^^22 


0 

a 


23 


0 


'^32  ^S3  \     ° 
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Friedman  [10]  has  shown  (Theorem  II)  that 


(2..15) 


-k  =  cr' 


and  so,  if  the  successive  scheme  converges,  the  simul- 
taneous scheme  will  also  converge „   We  have  thus  been 
able  to  produce  a  block  simultaneous  iteration  scheme 
which  converges} 

Theorem  1,   By  a  suitable  partition  of  the  matrix 

of  elliptic  difference  equations  it  is  possible  to 

obtain  convergence  of  the  simultaneous  and  succes- 
sive block  iteration  schemes. 

This  block,  however,  is  rather  large.   In  two  dimen- 
sions for  the  bi-harmonic  13  point  schemes  we  would  have 
to  couple  all  the  equations  for  mesh  points  along  two 
neighboring  lineso   The  coefficient  matrix  for  this 
coupling  would  be 


(2,16)      a 


kk 


\k       \k+l 
^k+lk  ^k+lk+1 


where  the  diagonal  A's  are  five  diagonal  matrices  and  the 
off  diagonal  A's  are  triple  diagonal  matrices.   The  off 
block  contributions  are  similarly  definede   In  terms  of  a 
mesh  picture  (for  the  13  point  bi-harmonic  difference 
approximation),  we  are  taking  the  contributions  of  the 
mesh  points  on  two  neighboring  lines  as  new  values  (solved 
for  values)  and  the  remaining  neighboring  mesh  points  as 
old  values. 
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solved  for 
values 


i-3  i-2  i-1   i   i+1  i+2 

In  the  case  of  the  25  point  trl~harmonic  difference 
equations  in  two  dimensions  we  would  need  the  contribu- 
tions from  three  neighboring  lines  of  mesh  points  coupled 
in  order  to  obtain  a  simultaneous  iteration  scheme  that 
would  be  related  to  the  successive  scheme  by  the  relation 
(2ol5)  and  hence  converge »   In  the  case  of  the  harmonic 
equation  in  two  dimensions  we  need  only  take  the  coupling 
of  mesh  points  along  one  line  in  order  to  have  the  simul- 
taneous and  successive  iteration  scheme  related  by  (2.ol5)o 

The  question  now  arises!   In  two  dimensions  can  we 
have  convergent  simultaneous  block  iteration  schemes  for 
elliptic  difference  equations  which  correspond  to  coupling 
along  a  line  of  mesh  points  only?   The  answer  in  the  case 
of  the  bi-harmonic  equation  in  two  dimensions  has  been 
answered  by  Windsor  [9],  who  has  shown  that  the  unextrap- 
olated  line  simultaneous  scheme  in  a  rectangle  will  not 
converge  when  the  boundary  conditions  that  are  prescribed 
are  the  function  and  its  second  normal  derivative o 


Ik 


Whenever  it  is  possible  to  relate  the  matrices  -^X) 
and  ^(o-)  by  an  equivalence  transformation  in  the  form 
given  below,  the  question  of  convergence  or  non-convergence 
of  simultaneous  iteration  schemes  is  equivalent  to  knowing 
whether  or  not  the  successive  scheme  converges; 
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where  Q,{\)    and  T(a)  are  lambda-matrices  such  that 
det  IqI  det  |t|  =  1.   If  the  transformations  Q,(a)  and 
T(a)  existed  and  |f(A)|  <  1  the  simultaneous  iteration 
scheme  would  converge. 

Friedman  LOJ  has  proved  the  existence  of  a  Q(A) 

and  T(X)  if  A  is  of  triple  diagonal  form.   In  this  case 

1/2 
f{\)    =   X  '     o      We  note  that  in  the  triple  diagonal  case 

the  order  of  correcting  the  equations  in  the  simultaneous  and 
successive  schemes  does  not  affect  the  asymptotic  rate  of 
convergence  L9Jo   However,  in  the  case  of  five  or  more 
diagonal  systems  the  ordering  does  affect  the  successive 
scheme,  yet  it  does  not  affect  the  simultaneous  scheme. 
It  seems  impossible  to  reconcile  this  case  and  the  gen- 
eralization of  Friedman' s  theorem  to  five  and  more  diag- 
onals may  not  be  possibleo 

Hence,  we  will  proceed  to  Investigate  the  convergence 
of  certain  simultaneous  schemes  for  all  order  harmonic 
difference  equations. 
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3.   A  Class  of  2p   Order  Blliptic  Difference  Equations. 

We  will  consider  the  class  of  elliptic  difference 
equations 


(3.1) 
where 


(3.2) 


(3.3) 


H  = 


V  = 


(H  +  V)P  «  U  =  Z 


0 


H 


N    0 
c 


0    ^   S 


the  elements  of  H  are  triple  diagonal  |a  «  m-  matrices  of 
scalars J 
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^j21  ^j22  ^j23   0 


(3.U) 


H.  = 
J 


°   ^j32  ^j33  ^Dk     0 


0   h.   ,  h. 


and  the  elements  of  V  are  diagonal  [x  x  jx  matrices  J 


{3.5) 


G  .  = 
J 


0   C.J   0 


0 


0    c  . 

3^ 


(3.6) 


N 


n.^    0 


0 


n  .^ 


0   n 


3[^ 


(3.7) 


M.  = 
J 


m  .-.         0    .  .  . 

0    m  .^    0 


0 


0   m 


Jt^ 
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U  and  Z  are  column  vectors  x^ith  [j » v  elements  and  p  is  a 
positive  integero   This  class  of  difference  equations  is 
suggested  in  analogy  to  the  p   harmonic  differential 
equation  in  two  dimensions  where  H  and  V  are  the  three 
point  difference  approximations  to  — rr  and  — -r   respec- 
tively.   For  p  =  1  we  would  have  the  five  point  approxi- 
mation to  the  harmonic  differential  operator  in  two  dimen- 
sions; for  p  =  2  we  would  have  the  thirteen  point  approxi- 
mation to  the  bi-harmonic  differential  operator;  for  p  =  3 
we  would  have  the  twenty-five  point  approximation  to  the 
tri-harmonic  differential  operator;  etc. 

It  is  for  the  class  of  difference  equations  (3ol) 
that  we  would  like  to  know  whether  block  simultaneous 
schemes  converge.   Some  we  know  do  converge;  those  schemes 
which  come  under  the  conditions  of  theorem  I;   some  we 
know  do  not  converge;  the  bl-harraonic  line  scheme  treated 
by  Windsor  [7  J  o 

To  say  anything  about  simultaneous  iteration  schemes 
for  solving  (3ol)  without  some  further  restrictions  on  H 
and  V,  seems  very  difficult.   We  will  therefore  assume 
that  H  and  V  commute < 

(3.8)  HV  =  VH 
Prom  (3»2-3oU)  we  find 

(3.9)  H.Cj  =  C.Hj 
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(3.10)  H.Nj  =  N.K.^, 

(3.11)  Hj^.H.,,  =  M.,,H^ 

Since  C  •  is  diagonal  ^  vje  ccnclude  from  ( 3»9 )  that 

(3.12)  C,  =  Y.I,, 

where  v-  is  a  constant  and  I   is  a  ll  «■  u,  unit  matrix. 
( Proin  novj  on  we  will  use  the  subscripts  ^  and  v  to  desig- 
nate the  number  of  rows  and  columns  in  a  square  matrix, ) 
The  relation  (3-10)  shows  that  all  H.  are  similar  because 
of  the  transitivity  property  of  the  similarity  relation- 
ship.  From  (3»10-3»11)  we  have 

(3.13)  H.N.M.^T  =  N.M.^tH.^t 

J  J  J+1     J  J+1  J+1 

Since  li  .  and  M  .  .  t  are  diagonal  matrices,  their  product 
will  be  diagonal  and  commute  with  H.  if 

(3.1U  N^.M.,,  =  ^jl^ 

vjhere  7^.    is  a  scalar,   ¥e  have  obtained  the  conditions  on 
the  elements  of  H  and  V  by  equating  the  elements  of  the 
commutator  of  HVo   No  other  restrictions  are  necessary  for 
H  and  V  to  commute;  therefore  we  have 

Lemma  1,   H  and  V  will  commute  if,  and  only  if  • 

(1)   the  diagonal  blocks  of  V  are  scalar 
matrices ; 

C.  =  V.I 
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(il)   the  diagonal  elements  of  H  are  sim- 
ilar vjith  the  similarity  transforma- 
tion 

and 

(ill)   the  non-null  off  diagonal  elements  of 
V  are  such  that 

We  are  interested  In  difference  equations  derived 
from  some  sensible  approximation  to  elliptic  differential 
equations,  and  in  these  cases  other  restrictions  on  H  and 
V  followo   If  H  were  derived  from 

K(x,y)  £^(^»y)  +  L(x,y)  j^^""'^"^    +  P(x,y)  w(x,y)  and  V  from 
dx 

o 

R(x,y)  ^(^^y)  +  s(x,y)  |H(^.y)  +  Q(x,y)  w(x,y)  by  three 

point  approximations  J  we  would  find 

(3ol5)     Kw    +  Lw   +  Mw  ^  (K.  .1.  +  L.  A.  )u.  ,  . 

by  Taylor  series  approximation  to  the  derivatives  of  w;  i,e. 

1  i-1 J     1  ij    'i  i+1 J 


Ml 
XX 


and  similarly  for  w  »   The  coefficients  i.  ,  f .  and  v.  and 
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t.  ,   b   and  3.  are  dependent  on  the  mesh  spacing  onljo 
From  (3.l5)  we  see  that  the  elements  of  H.  are 

(3.16)  h.  .  .  -,  =  K.  .j2.  +  L.  .A. 

J  1  1-1     ij  1     ij  1 

(3.17)  ^-ii  =  -  2(Ki/i  -L,.b^  -|m..) 

(3.18)  hj.  .^^  =K..r,  -L,.f3.    , 

If  we  multiply  (3.10)  out  In  detail,  we  see  that  the 
diagonal  elements  of  H.  are  independent  of  j{ 

(3.19)  ^-ii^^i 

say;  and  the  off  diagonal  elements  satisfy 

(3.20)  h  ,  ,  .  h.  .  .  T  =  h.^,  .  ,  .  h.^,  ,  ,  . 

ui-1  1   J  11-1     j+li-li  j+li-li    ' 

which  implies  h  .._.,.  h  ...  _^  is  independent  of  j ,   Since 
1  and  j  are  independent  indices,  we  conclude  from  (3.17) 
and  (3.19)  that  K.  .,  L.  .  and  M.  .  are  independent  of  j„   Then 
from  (3.16)  and  (3.I8)  we  have 

(3.21)  h.  .._^  =h,,.^ 

(3.22)  hjii-hl  =  h,i-.l   » 
quantities  independent  of  j. 


Thus  we  arrive  at  the  result  that  H.  is  Independent 


of  j: 
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(3o23)  E.    = 


^'21    ^^22  ^23      0      .00 


0     ^32   ^33   h3^     0 


0 


0      h .  .    -,    h .  .    h .  .  . -,    0 
11-1      11      11+1 


=  H 


We   can  vrrlte 


(3.24)  H  = 


/^^      0      ,.. 

^  0     7f  0      . 


-    V'^ix 


where  we  have  used  the  direct  product  of  two  matrices  nota- 
tion [10]. 

From  (3<>10)  and  3»23)  we  conclude  that  N.  is  a  scalar 
matrix; 


(3.25) 


N.  =  n.I 


where  n.  is  a  constant.   Finally  we  conclude  from  (3«lU) 
that 


(3.26) 


M.  =  m.I 


where  m.  is  a  constant.   Thus  we  can  write 
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(3o27) 


V 


v,  I   n,  I  0    ,  .  , 

1  u   1  u 

m„I   Vol  n^I    0 

2  u  2  u  2  u 


0 


in-,1   Vol   n,I   0 
3  u   3  u  3  u. 


V    u 


1/     being  the  triple  diagonal  matrix  of  scalars  m. ,  v.  and 

n. o   Since  we  have  found  the  conditions  for  the  commuting 
1  ^ 

of  H  and  V  by  solving  the  resulting  element  equations  of 
HV  =  VH  when  H  and  V  are  arrived  at  by  three  point  Taylor 
series  approximations,  we  have 

Theorem  2,   If  H  and  V  is  derived  from  three  point 
Taylor  series  approximations  to  a  second  order  linear 
elliptic  differential  operator,  H  and  V  will  commute 
if,  and  only  if, 

H  =  I  x«^ 

V  V 

V  =  2/  xol 

V  V 

In  terms  of  a  mesh  picture,  the  region  must  be  a  rec- 
tangle and  the  variable  coefficients  in  the  differential 
operator  must  be  functions  of  x  only  when  multiplying  the 
X  derivatives  and  functions  of  y  only  when  multiplying  the 
y  derivatives.  The  result  of  Birkhoff  and  Varga  [11]  is  a 
special  case  of  theorem  2J  the  case  when  the  differential 
operators  have  constant  coef f icientSo 

Furthermore  J  we  see  that  the  boundary  conditions  at 
all  the  points  on  the  left  side  of  the  rectangle  are  the 
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seime  because  H  =  I  x°^  ,  i.e.  the  boundary  conditions  im- 
plied in  H  and  therefore  'H      are  Independent  of  the  j  index 
--  the  numbering  of  the  points  along  the  left  side©   Sim- 
ilar considerations  apply  to  the  other  sides.   The  only 
boundary  conditions  that  are  possible,  because  of  the  form 
of  %     and  T/'    are  even  normal  derivatives  given  or  odd  normal 
derivatives  given. 
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I|-.   The  Line  Simultaneous  Iteration  Scheme., 

Line  simultaneous  iteration  schemes  are  characterized 
by  the  mesh  picture  fact  that  a  line  of  mesh  points  is  cor- 
rected using  old  values  on  the  surrounding  llneso   In  terms 
of  the  class  of  difference  equations  considered  in  §3  we 
will  formulate  line  simultaneous  schemes » 

Under  the  conditions  of  theorem  2  (the  only  cases  con- 
sidered for  the  remainder  of  the  paper),  we  can  ii7rite  the 
difference  equations  Od)  as 


(U.i)    g:(g)(V.^P-'<)(e.$..i^)u  =  z 

since  H  and  V  commute  and  are  of  the  form  given  by  (3«2i|) 
and  (3»27)o   For  the  construction  of  line  simultaneous 
Iteration  schemes,  we  consider  the  following  splitting  of 
Z^^x.I  :   let 


([|„2)     My^X'l    )   =    (-)^max|v!^^|l  x-I   =^2/^x«I 

^  V     jj,'     '   '    ^   '   11   '   V     \l  V     \l 

a  diagonal  scalar  matrix,  where  v..   are  the  diagonal  ele- 
ments of  2/  x»I  .   ¥e  define  the  remaining  part  of  the  split- 
ting  as 

With  these  definitions  of  diagonal  scalar  matrix  and  remain- 
ing part  matrix,  we  easily  verify 
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Lemma  2»   The  matrices 
^If   x-I  ,  ^Z/'x°I  ,  iQir\''L      and  <^irx°I   commutBo 

We  now  define  an  Iteration  scheme  which  we  will  call 

"separable  line  simultaneous o"   Using  the  splitting  of 

st 
([|-o2)  and  ([|o3),  the  n+1    Iterate  Is  given  by 

or  In  terms  of  the  error  defined  by  (2o8) 

k=0  ^     V    t^  k=0  "^  ^         V- 

where  we  have  combined  the  matrix  products  Into  direct  prod- 
ucts of  matrlceso 

The  matrix  equation  (U«5)  Is  of  the  form 

and  If  we  expand  the  Initial  guess  e^    into  eigenvectors 

-1   2 
of  -R  SS 

V 

r=l 
a=l 

where  ^'^^'    Is  an  eigenvector  of  -R°"  S,  we  see  from  (Ij-o6) 
that 


The  expansion  (i|o7)  is  possible  if  the  elementary  divisors 


of  R"  S  are  simple «   We  will  assume  this  fact  and  in  all 

bec{ 
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our  examples  it  will  be  true  because  %     and  XT    will  be 
symmetric o 


r,s 

where  X    is  an  eigenvalue  of  the  matrix  -R  S  correspond- 

rs         '^ 

(rs  ) 
ing  to  the  eigenvector  E,  » 

Substituting  (i+.b)  into  ik'S) ,    we  find  that  each 

eigenvector  satisfies  the  equation 


4^^^^  =  0 


We  can  further  simplify  (l|o9)  because  of  lemma  2,  and  the 
fact  that  "^  and  its  powers  commute.   Since  all  the  \x  "  [i 
matrices  commute,  they  have  common  eigenvectors;  since  all 
the  V  *  V  matrices  commute,  they  have  common  eigenvectors  5 
since  the  matrices  in  (I|.«9)  are  in  directed  product  form, 
we  can  write 

where  the  subscripts  ^   and  v  indicate  the  number  of  rows 

(r )       is)  ( s) 

In  the  vectors  £     and  £     respectively,  and  where  £ 

is  a  common  eigenvector  of  the  v  "  v  matrices  of  (l4o9)  and 

E,  is  a  common  eigenvector  of  the  11 '^  n-  matrices  of  (L|.<.9). 

Thua 

(i+oii)         42^^  4^^  =  o-(^^  4^>    , 

(ii, 12)  ^y^  ?("^  =  p^^^  ^(^^    , 

^  V   V       ^s    ^v 
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and 

where  o-    ,  p    and  h   are  the  eigenvalues  of  the  matrices 
i^v'  ^^v  ^^^  ^1°   Substituting  (i+dO)  into  (U„9)  and 

V         V  [X 

using  (L|.oll-i|ol3) ,,  we  find 

Theorem  3"   The  eigenvalues  of  the  error  matrix  for 
the  "separable  line  simultaneous"  iteration  scheme 
given  by  (U^U)  are 


(U»14)  X^3  -     ^-° 


(P)  p(k)  ^p^k 


k=0  '^         ^ 

It  is  interesting  to  note  that  we  have  said  very  little 
about  the  matrices  1/    and  74'  ,    except  that  they  are  triple 
diagonal o   Knowing  the  eigenvalues  of  the  v  ^  v  and  the  p,  x  p, 
matrices  in  (UoU)  is  sufficient  to  find  the  eigenvectors  of 
the  [X'V  x^L-v  matrix  R~  So   In  terms  of  a  mesh  picture  we 
have  found  a  large  class  of  two-dimensional  iteration  schemes 
whose  error  matrix's  eigenvalues  'k        are  evaluable  in  terms 
of  rational  functions  of  eigenvalues  a~      ' ^    p_    and  h  of 
one-dimensional  operators  42/.,?  ^Z/",,  and  %  <, 

V        V         \i. 

We  have  called  the  scheme  given  by  ([|.oi|)  "separable 
line  simultaneouso"   The  designation  "separable"  is  clear  in 
view  of  (Lj-olO);  the  designation  "line  simultaneous"  is  not 
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clear.   We  will  clarify  "line  simultaneous"  by  a  series  of 
examples  in  the  next  section., 
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5o   Examples  of  "Separable  Line  Simultaneous"  Iteration 
Schemes  o 

The  case  of  p  =  1  Is  the  so-called  "line  Richardson"' 
scheme  [[(.jo   For  equal  spacing  /\x  in  the  i  direction  (x  or 
horizontal  direction)  and  equal  spacing  /\y  in  the  j  direc- 
tion (y  or  vertical  direction)  and  for  the  case  when  the 
unknown  is  prescribed  on  the  rectangular  boundary..,  we  have 

/  2   -1    0 
"1    2-1    0 
(5cl)     7^  =  ^^— TT     0-1    2-1    0 


(A^)' 


0 


(5„2)    Ir    =-~L~ 
"      (Ay)^ 


2 

-1 

0 

o     o 

1 

2 

-1 

0 

0 

-1 

2 

-1 

and  the  equation  for  a  component  of  the  error  is  (cfo  (Li.o9)) 

(5.3)  x^^az/^x.^^.^v^,'*'"^^' 

We  easily  verify  that  the  eigenvector  E,  is  (see 

(l+.io)) 
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(5oi|) 


^(s)         (r) 


sm 


3xn 


sin 


sm 


sin 


sm 


sm 


sm 


IxriT 


for  with  ^     given  by    (5ol)    and   4  given  by    [SoL\.)^    we   have 


(5o5)         >^^^^ 


^)    =  __2  (^    .,   ^^3   ^)4^^^    ^   h  ?^^^         5 


for  with  7/    given  by  (5  =  2 )  and  ^,  ''  given  by  (5o^)s  we  have 


(5,6)     i?/0  (s)^^_j_ 

(Ay) 


r(s)  ^     (0)    (s) 

2  S    -  '^s    ^v 


(5o7) 


l?r  e^^^  =  2.,,  .(s)  ^    (1)   (s) 

(Ay) 


V  ^v 


'V 


(5<.b)     «2r°  4^^^  =   Oo?.^^^ 


V    V 


„(0)  .(s) 


and 


(5o9)     ^y4(^)=z_^ 

'    "         (Ay) 


2 


COS  ^  4^'^  ?  P^l^  C^"^ 
v+1  ^v     "^s   ^v 


Prom  theorem  3  the  eigenvalues  of  the  error  matrix  for  the 
"separable  line  simultaneous"  scheme  (5o3)  with  p  =  1  are 
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(5.10) 


:Ay) 


sit 

„  COS  — -r- 

2.  v+1 


ra 


(A^) 


(A^)'^     (Ay)' 


the  result  found  in  the  literature  (cfo  \\\\)  •> 

Per  a  general  p  and  %     and  If     given  by  (5°l-o2)  we 

th 
would  be  approximating  the  p   harmonic  differential  equa- 
tion with  the  function  and  the  first  p  even  normal  deriva- 
tives given  on  the  rectangular  boundary.   Again  a  component 
of  the  error  is  given  by  (Soil).   We  have  the  v^  v  matrix 


/ 


(5ai)    Z/^  = 


-    1 


(Ay) 


2k 


,     xk+c-r/2k        N         ,     X 

(~)        Vk+c-ry  -  (") 


k-c-r/2k 


■2k        \ 

k-c-r/ 


\ 


where  it  is  understood  that 


r,c  =  l,2,"oo,v 


(5.12) 


/ 


2k 


( 2k )  i 
H2k  -  r)l 


=  0 


if  0  <  r  <  2k 

if  2k  <  -J^  or   r  <  0 


For  k  =  I5  (5«11)  agrees  with  {S'2)    and  by  induction  we 
establish  the  7/   is  as  given  by  (5oll)o 
The  scalar  matrix 


5ci3)         AV^,  = 


(Ay) 


2k 


{~y 


2k 
k 


-   3>k  - 


and    the    remainder  matrix 


(5«1]4) 


:^k  ^  -  1 


'      (Ay)^ 


Lk+c-r / 


(_J...-X 


-  (-)--'-r' 


^2k\ 


\  ^+c-ry 


I  0  /-'-'T.N 

\i-c~rj  \  k/ 


/ 


where    6        Is    the    Kroneker   delta.      The    eigenvectors   of   the 
re  ° 

scalar   matrix     Sj/     are    given  by    (5»U)f    the   eigenvalues   of 
the    scalar  matrix    (5ol3)    are 


5oi5) 


o- 


(k)    _  1 


(Ay) 


-  ""C 


The  eigenvectors  of  the  remainder  matrix  are  given  by  (SoU); 
the  eigenvalues  of  the  remainder  matrix  (5oli|)  are 


(^"^^)   Pi'^  =  TT^  &'^^-^^'''  S?^^°^  ^^-^^^^ 


(Ay)     ^=0 


0 
^2 


Using  theorem  3s  we  obtain  the  eigenvalues  \        of  the 
"separable  line  simultaneous"  error  matrix! 


(5,17) 


rx 


^(k)i-^(^°^ffe-i)r^T^2r(v)(-2)^-2i(?)oos(>r-2r)^ 

^2 


v+1 


^ 


k=0 


k 


(cos  :-rr  -   1 ) 


p-k 


:Ay) 


2k  ^  ''  ^  k  '' 


-  3^ 


For  p  =  2  and  /\x   =  /\y  =  1 ^  we  obtain 

a  cos  _  .  8  cos  ^;^  +  9 

which  Is  the  result  Windsor  [6]  obtains  and  calls  the  "line 
simultaneous  displacement"  scheme,.. 

It  is  interesting  to  note  that  A    takes  on  its  upper 

nx  sir 

bound  when  cos  —rr-  -*  1  and  cos  -~rr  -^   1.  and  its  lower  bound 

^L+l  V+1 

T-VTT  six 

when  cos  — -r-  —>-    1  and  cos  — — =p-  — »  -lo   These  values  are 
^+1  v+± 

approached  for  an  r^s  when  the  mesh  becomes  very  fineo   Prom 

(5  -17)  by  simply  summing  the  combinatorial  series  with 

cos  — rr  =  cos  —rr   =  1 ,  we  find 
^,+1       v+1 

(5019)  sup  X^3  =  1 

r  ,s 

From  (5ol7)  by  summing  the  combinatorial  series  with 

m  sTi 

cos  —rrr  -   1  and  cos  —r  =  ~1 ,   we  find 
|j,+l  v+1 

(5020)  inf  x^^-   1    ~  -^-         , 

r,s  \P/ 


For  p  =  2 


(5o21)  inf  X^3  (p=2)  =  -  I 


the  result  found  by  Windsor  [6] 
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We  are  thus  justified  in  calling  the  scheme  given  by 
(lloll-)  "separable  line  simultaneous." 

Except  for  p  =  1,  the  case  which  comes  under  theorem  1, 
the  "separable  line  simultaneous"  schemes  diverge.   However, 
if  we  were  to  extrapolate  with  an  extrapolation  constant 
a  <   1,   we  could  obtain  a  convergent  scheme}   this  type  of 
extrapolation  will  increase  the  lower  bound  keeping  the 
upper  bound  below  one  [12].   For  p  =  2  this  result  was  found 
by  Windsor  [6] , 

There  are  other  possibilities  for  which  we  can  explic- 
itly find  X      o   If  there  is  a  symmetry  (even  normal  deriva- 
tives  given)  condition  on  the  top  boundary,  we  would  have 
the  difference  equations  for  the  approximation  of  the  p 
harmonic  differential  equation  given  by  (5ol)  and 

/  2   -1    0   .  o  „ 
/  -1   2-1    0   o.» 
iSoZZ)  ?/,  = — ^   1   0-1    2-1    0   oo. 


^  0   .  ,  .  0-2 
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The  eigenvectors 


(5.23) 


(rs)  _ 


sm 


sin 


sm 


STt  \ 
2v 

Zsn 
2v 


ISTI 


2v 


sin 


sm 


sin 


M.+1 
2ni 


irit 


sin 


2v  , 


sm 


and  the  eigenvalues  X    can  be  computed  in  terms  of  the 
eigenvalues  of  ^  given  by  (5»1)  and  the  eigenvalues  of 
^^      and  If^lr     easily  computable  from  (5o22)o   Other  ex- 
plicit examples  corresponding  to  symmetry  on  other  bound- 
aries can  easily  be  determinedo 
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6.   Separable  Line   Successive  Iteration  Schemes » 

Because  of  our  Inability  to  extend  Friedman's  theorem 
connecting  the  asymptotic  rates  of  convergence  of  all  line 
simultaneous  and  line  successive  schemes,  we  will  Investi- 
gate explicit  solutions  of  the  class  of  equations  given  by 
(l|ol)  with  a  view  of  partially  xxnderstandlng  the  relation- 
ship between  line  simultaneous  and  line  successive  schemes. 

Line  successive  schemes  are  characterized  by  the  solv- 
ing of  all  the  equations  coupled  along  a  line  (a  one  dimen- 
sional problem)  using  corrected  neighboring  contributions 
to  the  equations  whenever  available.   In  order  to  formulate 
this  type  of  iteration  scheme,  we  define  the  following  de- 
composition of  the  vertical  difference  operator 

(6,1)     lr\oj     =  av'^X'l    )   +  ^2/^x»I  +  nilr^x'l    ) 

V^L         V^  V(J,         Vjl 

where  >9'Z/  x»I   is  given  as  before  by  {l\.,2} ,    the  lower 
matrix  as  a  matrix  with  zeros  above  the  diagonal  and  the 
rest  of  the  matrix  unchanged: 


(6o2)     fiil/^x^l    )  - 


V 


.(k) 
11 

(k) 
21 

(k) 


V 


V 


0 

(k) 
22 

(k) 


0 
,(k) 


31   "32   "33 


0 


X'l 


> 
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and  the  upper  matrix  as  that  matrix  with  zeros  on  and  below 
the  diagonal  and  the  remaining  elements  of  the  matrix  un- 
changed: 


(6.3)    u(y^x.I  )  - 


0  V 


:k)  ,  (k) 


12 


0   0 


0   0 


'13 

23 
0 


V 


V 


(k) 
(k) 

3U 


X.I 


V- 


nV 


k 


[^ 


We  now  define  "separable  successive  line"  Iteration 
schemes  as  those  schemes  In  which  a  component  of  the  error 
^(rs)  ^  ^(r)^.^(s)  3^tlsfles 


(6.U) 


k=0       —  ^  *^  r-  _ 


(r) 


Since  '}{'     and    Its    powers    only   operate    on   E,^       ,    and    since 
i-i/^   has   eigenvalues    given  by    (i+oll),    (6,[|)    reduces    to 


=  0 


(6.S)  5Z(Dhr'' 


k=0 


r^r-x"^^ 


^  *    a- 

V      s 


^^h    )    +  u?A 


which  Is  a  set  of  equations,  each  of  the  order  of  (In  the 
mesh  picture)  a  one -dimensional  problem.   The  matrices 
fl}/      and  uV   do  not  have  a  common  set  of  eigenvalues  5 
therefore  we  cannot  In  general  simplify  (6o5)  and  solve 
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Tor  the  eigenvalues  \^^   of  the  error  matrix  In  terms  of  the 
eigenvalues  of  fi-V^   and  nV    .   We  can  state  no  more  than 

Theorem  l\..      The  eigenvalues  \        of  the  error  matrix 
for  a  "separable  line  successive"  iteration  scheme 
satisfy  the  eigenvalue  equation 


(6.6)     iJZO  hl-Kv^)zl'^ 
k=0   ^   ^    ^   ^ 


=  -v3<2:<'"^r''i^^^--i'M)?; 
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7.   Exaraples  of  "Separable  Line  Successive"  Iteration  Schemes 

The  case  of  p  =  1  is  the  so-called  "line  Liebmann"' 
scheme  [1|]  for  the  harmonic  difference  equations.   In  this 
case  the  eigenvalues  of  the  error  matrix  and  eigenvectors 
satisfy  the  equations  (see  (6.6)) 


(7.1)   h  £ 


(s) 


r  V 


->. 


rs 


(s) 


h    (I   +  J^h  +  if^y  +  (T^^^i  ) 

rs   V     s         V     s    V 


The  eigenvectors  ^     are  of  the  form 


(7.2) 


(s)  _ 


a   sm 


Z      . 
a   sm 


STI 

v+1 

2311 

v+1 


a"^  sin 


v+1 


.(s) 


V    .    VSTt 

a   sm  ^^ 


where 
(7.3) 


-  -vl/2 
^  -  ^rs 


The  relation  (7.3)  is  easily  determined  from  (7ol)|  a  solu- 
tion of  a  quadratic  equation  is  involved  in  obtaining  (7.3)  • 
Prom  (7.1-.3),  (6, 2-. 3)  and  (5.1-o2)  we  obtain 


(7.U) 


:Ay)' 


cos 


STt 
V+1 


\2 


7v 


rs 


(A^) 


■r^    cos  — pr  -  (■ 


A^)"^      (Ay)' 
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which  is  the  square  of  the  eigenvalues  of  the  corresponding 

"separable  line  simultaneous"  scheme »   This,  of  course,,  is 

the  value  for  X    that  is  found  in  the  literature  ik] . 
rs 

For  p  >  1  (7o2)  is  still  the  form  of  the  eigenfunction 
for  the  equation  (6.6),  but  a  is  not  given  by  (7o3)  and  in 
trying  to  find  a,  we  are  led  to  a  polynomial  equation  for 
a  of  order  2p»   Except  for  p  =  2,  this  polynomial  equation 
cannot  be  solved  explicitly  and  in  the  case  of  p  =  2  the 
result  is  very  messy  and  will  not  be  exhibited  here.   This, 
possibly,  accounts  for  the  fact  that  no  solutions  of  these 
equations,  other  than  the  case  p  =  1,  are  found  in  the 
literature  o 
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8»   Alternating  Direction  Scheme So 

There  are  currently  two  types  of  alternating  direction 
schemes  described  in  the  literature;  the  Peaceman  Rackford 
[13]  (PR)  and  Douglas  Hackford  [Ik]    (DR)  schemes. 

The  PR  scheme  is  a  special  case  of 

(6.1) 

k=0  ^    V    ^L      V    tx         k=q+l     V    tx      V    ^ 

(n+i.)     (n) 

=  Z+(^(U    "^      -  J]         ) 
n 

(8.2) 

(n+l)     (n+j) 
=  Z  +  a/^(u      -  U   "^  )   , 

where  f«/  are  suitably  chosen  parameters  which  hasten  the  re- 
duction of  errors,  and  q  is  an  integer  between  0  and  p.   When 
q  =  0  and  p  =  1 ,  we  obtain  the  scheme  originally  treated  by 
Peaceman  and  Rackford  [13 ]« 

As  p  increases,  there  are  a  multitude  of  possible 
schemes.   However,  in  each  of  these  schemes  it  is  not  possi- 
ble to  "simply"  solve  the  resulting  coupled  difference 
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equations „   The  quantity  2q  +  1  is  the  number  of  lines  of 
points  coupled  on  each  alternating  sweep:   for  the  original 
PR  scheme,  q  =  Oj  the  number  of  lines  coupled  is  lo   The 
success  of  the  PR  scheme  for  p  >  1  depends  on  two  condi- 
tions;  (i)  the  choice  of  a  set  of  UJ     guaranteeing  good 
reduction  of  errors  and   (ii)  the  possibility  of  coupling 
one  line  of  points  so  that  a  matrix  of  small  order  need  be 
inverted. 

The  DR  scheme  uses  the  difference  scheme  derived  from 
the  differential  equations  on  the  first  sweep,  but  on  the 
second  sweep  a  relationship  between  parts  of  the  difference 
operators  are  used,  which  guarantees  reduction  of  errors » 
A  generalization  of  the  DR  scheme  is  given  by  (tiol)  and 


1,±— — Tt  k    V    u       V    u. 


When  p  =  1  and  q  =  0 j  we  obtain  the  scheme  first  treated  by 
Douglas  and  Rackford  [llj.]  ;  when  p  =  2  and  q  =  0  _„  we  obtain 
the  alternating  direction  treatment  of  the  biharmonlc  given 
by  Conte  and  Dames  [l5]« 

Defining  the  error  as  in  (HoB),  we  obtain  the  error 
equation  for  the  PR  scheme  from  (6ol)  and  (b<,2)  as 


U5 


r-  J9- 


(8.i|) 


:n+l)  = 


1_  (E)(v-^^-')(^^-i„)  -^. 


k=q+l 


M- 


n 


>_  (P)(I  x.?^P-^)(2^^x.I  )  +A/" 

k^   k    V    tx      V    (1     n 


^ 


L  k=0 


.  (P)(i,x.:)<p-'')(2.^-.i^)  -  w. 


1-1 


n 


^  J^ 


ZZ     (E)(Ix-^-^)(2/^.I„)  .U^l-e^-) 


-k=q+l 


'k'^-^v 


V    ti' 


n 


Since  V  and  2^  commute,  we  can  expand  the  error  as  in 
(1|,8)  and  (^,10); 


(8.5) 


;n)  ^  ^  A^°^  -^      r(s)^.^(r) 


r  ,s 


X    4'  'x.4 
rs    rs  ^v     ^ 


where  \        are  the  eigenvalues  of  the  matrix  in  (ti.[(.).   If 

1/  s 


(8.6)    ir    4^^^  =  V  c^^^ 
^v   V      s  ^v 


we  obtain  from  (ti,l+),  (8,5)  and  (l4.al3)  the  eigenvalues  \      i 

Theorem  5.   The  eigenvalues  of  the  error  matrix  for  the 
PR  alternating  direction  scheme  are 


(8.7)    X 


PR)  _ 


k=0 k=q-*-l 


rs 


(  YZ  (£)  hP-V  -  w){yZ  (F)  hP-V  -  y ) 

,  £ — :<,  k    r    s    n   f— tt'  k    r    a     n 


k=q+l 


k=0 
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In  a  similar  manner  we  find  the  eigenvalues  X   for  the 

&  rs 


DR  scheme! 


Theorem  6.,   The  eigenvalues  of  the  error  matrix  for  the 
DR  alternating  direction  scheme  are 


(P)  hP"V  >   (P)  hP-V  ^v^^ 
(8,6)  X^°^^  =  ___kzO___ __ kz£±L 


f— r'  k   r    s  1.^— 7<,  k'  r    s     n    n   r   s' 


k=0  k=q+l 

There  are  many  other  alternating  direction  type  schemes  J 
for  example,  a  set  of  q   can  be  given  in  (bol)  and  (8p2)  or 
(8ol)  and  (8o3)o   It  is  an  easy  exercise  to  find  the  error 
matrices  and  their  corresponding  eigenvalues  in  terms  of  the 
eigenvalues  of  'H     and  V   „   We  will  consider  only  one    other 
scheme  which  we  will  call  the  "simple  alternating  direction 
scheme  (S)o   The  first  sweep  is  the  same  as  the  PR  scheme 
(8ol)  and  the  second  alternating  sweep  is 

(P)(V=WP"^)(^^x.I  )U"   2 
k=q+l  ^        ^        \^  V    ij. 

As  before  the  eigenvalues  are  easily  determined  in  terms 
of  the  eigenvalues  of  H     and  2/ „   We  have 
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Theorem  7.   The  eigenvalues  of  the  error  matrix  for  the 
S  alternating  direction  scheme  are 
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9«.   Eigenvalues  and  Eigenvectors  of  Some  Alternating  Direc- 
tion Schemes o 

The  first  alternating  direction  scheme  was  that  ex- 
hibited by  Peaceman  and  Rackford  [131 «   In  our  terminology 
q  =  0  and  p  =  1«   If  we  consider  the  case  of  Dirichlet 
data  on  the  boundary,  ^  and  V     are  given  by  (5-1)  and 
(5«2).   The  eigenvectors  of  the  error  matrix  are 


(9ol) 


(rs)   _ 
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and   the    eigenvalues   given  by   theorem   5   are 


(PR), ,    _    <^-^^'<%   *'^n' 

S7 


(9.2)  Xj.^ '(p=l,q=0)    =    (/   .    ^")( 


n        r 


The  eigenvalues  h   are  given  by  [S ,S)   while  the  eigenvalues 

V  are  given  by  a  similar  expressiono   The  choice  of  iV  <  0 
will  ensure  Ix),    |  <  1  because  h   and  v  >  0,  since  they 

X  o  1  s 

are  eigenvalues  of  the  positive  definite  matrices  %     and  1/  . 

IJ,  V 

The    success    of    this    PR   scheme    depends   on   a   choice    of 

VI  -   -   Yv     for   each  r^ 
n  r 
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The  Douglas  Rackford  [ll|.]  scheme  in  our  terminology  is 
obtained  when  q  =  0  and  p  =  1,   The  eigenvectors  are  given 
by  (9.1),  and  the  eigenvalues  of  the  error  matrix  are  given 
by  theorem  6; 

(9.3)     xi?^^p=l;q=0)  = ^  ^    ^ 


v  h^  +  W^  -  IV  (h  +  V  ) 

s  r    n    n   r    s ' 

Since  v   and  h  >  0,  a  choice  of  <V  <  0  will  ensure 
U  ?^  (P=l;q=0)  I  <  1  for  all  r  and  s. 

Recently  a  scheme  for  the  solution  of  the  biharmonlc 
has  been  proposed  by  Conte  and  Dames  [iSJ^   This  scheme  is 
of  the  DR  type  with  q  =  0  and  p  =  2o     The  eigenvectors  of 
the  error  matrix  are  given  by  (9ol)  and  the  eigenvalues  are 
given  by  theorem  6; 

/no  (2h  V   +  v^)h'^  +  k^ 

(9.i^)    Xi?^^(p=2;q=0)  =  r  s     s   r     n 


rs   ■"   '^   '    ,„,     .2 


(2h  V   +  v^)h^  +  W^  -  ^^/  (h   +  v  )' 
'rs     s'r    n    n'r    s' 


In  this  case  a  choise  of  ^/  <  0  will  ensure 
|?^„_   (p=2;q=0)|  <  1  for  all  r  and  s.   In  general  a  choice 
of  (-)P|V  <  0  will  ensure  convergence  of  the  DR  scheme  as 
can  easily  be  seen  from  theorem  6, 


3 

In  a  private  discussion  Dr.  S.  Conte  expressed  the  opinion 

that  their  treatment  of  the  biharmonlc  was  a  generaliza- 
tion of  the  DR  scheme  and  not  the  PR  scheme,, 


-  50  - 


A  possible  PR  treatment  of  the  blharxnonic  equation 
would  be  q  =  0  and  p  =  2o   In  this  case  we  find  from  theo- 
rem Si 

rnox  (h^  +  U/  )(2h  V   +  v^  +  J^  ) 

(9.5)     xi!^^p=2;q=0)  -   ^    n    r  3    s    n 


""^  (h'^  ~  W  )(2h  V   +  v'^  -  IV  ) 

r    n    r  s     s    n 

We   can   choose  |«\/     <    0    and   obtain  convergence  <>      However,    the 

n  o  ^ 

work  required  to  solve  the  difference  equations  for  the  new 
values  on  the  second  sweep  --  equations  (8»2)  --  is  almost 
as  much  work  as  solving  the  original  difference  equations. 
On  the  second  sweep  each  line  of  points  is  coupled  with  the 
neighboring  lines  of  points,  which  in  turn  is  coupled  with 
their  neighboring  lines,  » » <,  until  we  arrive  at  the  boundary. 
The  S  alternating  direction  scheme  with  p  =  2  and  q  =  0 
affords  us  a  way  out  of  this  difficulty.   In  this  case  the 
eigenvalues  of  the  error  matrix  are 

/«>■»            (2h  V  +  v^  +  ii/  )^ 
(9,6)      xi!^p=Z?q=0)  =  ^-  ^     ^     ^ 


-  '^       '"   '       (h2  ^^  )2 

r    n 


For  convergence  of  this  iteration  scheme  we  must  have 

;e 


|x|,^^p=2  5q=0)|  <  lo   Henc< 


(9»7)      |2h  V  +  v^  +  »^/  I  <  |h^  -  IV  I 
'rs     s     n'    'r    n' 
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which  leads  to  the  condition 

(9.5)  U/  <  h^  -  ^(h  +  V  )2 

n     r        Z      r  s 

This  inequality  must  be  satisfied  for  all  r  and  s.   Thus  the 
set  of  l\/  must  be  chosen  such  that  all 

(9.9)  W^  <   min  ih^  -  |(h^  +  v^fl        , 

r,s 

It  is  not  possible  to  choose  k^     in  a  manner  which  will  allow 

n 

some  of  the  eigenvalues  of  the  error  matrix  to  vanish  on 
each  iteration.   Only  in  the  PR  alternating  direction  scheme 
is  it  possible  to  choose  a  set  of  M/  such  that  some  of  the 
eigenvalues  of  the  error  matrix  vanish  for  each  Iteration. 
These  results  easily  follow  from  theorems  5,  6  and  7. 
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